Pytest Monkeypatching
Part 2, Chapter 14
In this chapter, we'll use the pytest monkeypatch fixture to mock functionality in our tests.
Monkeypatching
Monkeypatching is the act of dynamically changing a piece of code at runtime. Essentially, it allows you to override the default behavior of a module, object, method, or function without changing its source code.
Let's look at a quick example.
Source code:
# twitter.py
import os
import tweepy
consumer_key = os.getenv("CONSUMER_KEY")
consumer_secret = os.getenv("CONSUMER_SECRET")
access_key = os.getenv("ACCESS_KEY")
access_secret = os.getenv("ACCESS_SECRET")
def get_friends(user):
"""
Given a valid Twitter user 20 friends are returned
"""
auth = tweepy.OAuthHandler(consumer_key, consumer_secret)
auth.set_access_token(access_key, access_secret)
api = tweepy.API(auth)
friends = []
try:
user = api.get_user(user)
except tweepy.error.TweepError:
return "Failed to get request token."
for friend in user.friends():
friends.append(friend.screen_name)
return friends
So, the get_friends function uses tweepy to authenticate against the Twitter API. Once authenticated, it then returns a list of twenty friends.
Test:
# test.py
import twitter
def test_get_friends(monkeypatch):
def mock_get_friends(user):
return [(lambda x: f"friend{x}")(x) for x in range(20)]
monkeypatch.setattr(twitter, "get_friends", mock_get_friends)
assert len(twitter.get_friends("testdrivenio")) == 20
test_get_friends uses the pytest monkeypatch fixture to create a mocked version of get_friends, called mock_get_friends, that returns a list of twenty strings. Then, during a test run, mock_get_friends gets called rather than the real get_friends function. This not only decreases the amount of time it will take for the test to run, but it also makes the test more predictable since it is not affected by network connectivity issues, outages in the Twitter API, or rate limiting issues.
That said, keep in mind that the test is not actually testing the get_friends function call; it's replacing the function's default behavior (authenticating and calling the Twitter API) with new behavior (simply returning a list of strings).
While mocking or monkeypatching can speed up test runs and make the tests more predictable, at some point in the testing process, possibly in a staging environment, you should test out all external communication so that you can be confident that the system works as expected. This is often achieved with some form of end-to-end tests.
In our tests, we'll use the monkeypatch fixture to mock database calls.
Unit Tests
Add a new file to "project/tests" called test_summaries_unit.py:
# project/tests/test_summaries_unit.py
import json
from datetime import datetime
import pytest
from app.api import crud, summaries
def test_create_summary(test_app, monkeypatch):
pass
def test_create_summaries_invalid_json(test_app):
response = test_app.post("/summaries/", data=json.dumps({}))
assert response.status_code == 422
assert response.json() == {
"detail": [
{
"loc": ["body", "url"],
"msg": "field required",
"type": "value_error.missing",
}
]
}
response = test_app.post("/summaries/", data=json.dumps({"url": "invalid://url"}))
assert response.status_code == 422
assert response.json()["detail"][0]["msg"] == "URL scheme not permitted"
def test_read_summary(test_app, monkeypatch):
pass
def test_read_summary_incorrect_id(test_app, monkeypatch):
pass
def test_read_all_summaries(test_app, monkeypatch):
pass
def test_remove_summary(test_app, monkeypatch):
pass
def test_remove_summary_incorrect_id(test_app, monkeypatch):
pass
def test_update_summary(test_app, monkeypatch):
pass
@pytest.mark.parametrize(
"summary_id, payload, status_code, detail",
[
[
999,
{"url": "https://foo.bar", "summary": "updated!"},
404,
"Summary not found",
],
[
0,
{"url": "https://foo.bar", "summary": "updated!"},
422,
[
{
"loc": ["path", "id"],
"msg": "ensure this value is greater than 0",
"type": "value_error.number.not_gt",
"ctx": {"limit_value": 0},
}
],
],
[
1,
{},
422,
[
{
"loc": ["body", "url"],
"msg": "field required",
"type": "value_error.missing",
},
{
"loc": ["body", "summary"],
"msg": "field required",
"type": "value_error.missing",
},
],
],
[
1,
{"url": "https://foo.bar"},
422,
[
{
"loc": ["body", "summary"],
"msg": "field required",
"type": "value_error.missing",
}
],
],
],
)
def test_update_summary_invalid(test_app, monkeypatch, summary_id, payload, status_code, detail):
pass
def test_update_summary_invalid_url(test_app):
response = test_app.put(
f"/summaries/1/",
data=json.dumps({"url": "invalid://url", "summary": "updated!"}),
)
assert response.status_code == 422
assert response.json()["detail"][0]["msg"] == "URL scheme not permitted"
So, we'll write all the same tests as before, but we'll monkeypatch calls to the CRUD service.
Add Summary
def test_create_summary(test_app, monkeypatch):
test_request_payload = {"url": "https://foo.bar"}
test_response_payload = {"id": 1, "url": "https://foo.bar"}
async def mock_post(payload):
return 1
monkeypatch.setattr(crud, "post", mock_post)
response = test_app.post("/summaries/", data=json.dumps(test_request_payload),)
assert response.status_code == 201
assert response.json() == test_response_payload
Get Summary
def test_read_summary(test_app, monkeypatch):
test_data = {
"id": 1,
"url": "https://foo.bar",
"summary": "summary",
"created_at": datetime.utcnow().isoformat(),
}
async def mock_get(id):
return test_data
monkeypatch.setattr(crud, "get", mock_get)
response = test_app.get("/summaries/1/")
assert response.status_code == 200
assert response.json() == test_data
def test_read_summary_incorrect_id(test_app, monkeypatch):
async def mock_get(id):
return None
monkeypatch.setattr(crud, "get", mock_get)
response = test_app.get("/summaries/999/")
assert response.status_code == 404
assert response.json()["detail"] == "Summary not found"
def test_read_all_summaries(test_app, monkeypatch):
test_data = [
{
"id": 1,
"url": "https://foo.bar",
"summary": "summary",
"created_at": datetime.utcnow().isoformat(),
},
{
"id": 2,
"url": "https://testdrivenn.io",
"summary": "summary",
"created_at": datetime.utcnow().isoformat(),
}
]
async def mock_get_all():
return test_data
monkeypatch.setattr(crud, "get_all", mock_get_all)
response = test_app.get("/summaries/")
assert response.status_code == 200
assert response.json() == test_data
Remove Summary
def test_remove_summary(test_app, monkeypatch):
async def mock_get(id):
return {
"id": 1,
"url": "https://foo.bar",
"summary": "summary",
"created_at": datetime.utcnow().isoformat(),
}
monkeypatch.setattr(crud, "get", mock_get)
async def mock_delete(id):
return id
monkeypatch.setattr(crud, "delete", mock_delete)
response = test_app.delete("/summaries/1/")
assert response.status_code == 200
assert response.json() == {"id": 1, "url": "https://foo.bar"}
def test_remove_summary_incorrect_id(test_app, monkeypatch):
async def mock_get(id):
return None
monkeypatch.setattr(crud, "get", mock_get)
response = test_app.delete("/summaries/999/")
assert response.status_code == 404
assert response.json()["detail"] == "Summary not found"
Update Summary
def test_update_summary(test_app, monkeypatch):
test_request_payload = {"url": "https://foo.bar", "summary": "updated"}
test_response_payload = {
"id": 1,
"url": "https://foo.bar",
"summary": "summary",
"created_at": datetime.utcnow().isoformat(),
}
async def mock_put(id, payload):
return test_response_payload
monkeypatch.setattr(crud, "put", mock_put)
response = test_app.put("/summaries/1/", data=json.dumps(test_request_payload),)
assert response.status_code == 200
assert response.json() == test_response_payload
@pytest.mark.parametrize(
"summary_id, payload, status_code, detail",
[
[
999,
{"url": "https://foo.bar", "summary": "updated!"},
404,
"Summary not found",
],
[
0,
{"url": "https://foo.bar", "summary": "updated!"},
422,
[
{
"loc": ["path", "id"],
"msg": "ensure this value is greater than 0",
"type": "value_error.number.not_gt",
"ctx": {"limit_value": 0},
}
],
],
[
1,
{},
422,
[
{
"loc": ["body", "url"],
"msg": "field required",
"type": "value_error.missing",
},
{
"loc": ["body", "summary"],
"msg": "field required",
"type": "value_error.missing",
},
],
],
[
1,
{"url": "https://foo.bar"},
422,
[
{
"loc": ["body", "summary"],
"msg": "field required",
"type": "value_error.missing",
}
],
],
],
)
def test_update_summary_invalid(test_app, monkeypatch, summary_id, payload, status_code, detail):
async def mock_put(id, payload):
return None
monkeypatch.setattr(crud, "put", mock_put)
response = test_app.put(f"/summaries/{summary_id}/", data=json.dumps(payload))
assert response.status_code == status_code
assert response.json()["detail"] == detail
Test
Make sure the tests pass:
=============================== test session starts ===============================
platform linux -- Python 3.10.1, pytest-6.2.5, py-1.11.0, pluggy-1.0.0
rootdir: /usr/src/app
plugins: anyio-3.4.0, cov-3.0.0
collected 27 items
tests/test_ping.py . [ 3%]
tests/test_summaries.py ............. [ 51%]
tests/test_summaries_unit.py ............. [100%]
=============================== 27 passed in 0.39s ================================
Parallel Test Runs
Next, since we're no longer hitting a database, we can run these tests in parallel with pytest-xdist.
Add the package to the requirements.txt file:
pytest-xdist==2.5.0
Update the containers:
$ docker-compose up -d --build
Run the unit tests in parallel:
$ docker-compose exec web pytest -k "unit" -n auto
=============================== test session starts ===============================
platform linux -- Python 3.10.1, pytest-6.2.5, py-1.11.0, pluggy-1.0.0
rootdir: /usr/src/app
plugins: anyio-3.4.0, forked-1.4.0, cov-3.0.0, xdist-2.5.0
gw0 [13] / gw1 [13] / gw2 [13] / gw3 [13] / gw4 [13] / gw5 [13] / gw6 [13] / gw7 [13]
............. [100%]
=============================== 13 passed in 2.78s ================================
We'll continue to run all tests locally throughout the rest of this course. That said, you are more than welcome to just run the unit tests locally and run all tests on GitHub.
✓ Mark as Completed